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Abstract 

We propose a new variational problem which we call the Split 
Variational Inequality Problem (SVIP). It entails finding a solution of 
one Variational Inequality Problem (VIP), the image of which under 
a given bounded linear transformation is a solution of another VIP. 
We construct iterative algorithms that solve such problems, under 
reasonable conditions, in Hilbert space and then discuss special cases, 
some of which are new even in Euclidean space. 

1 Introduction 

In this paper we introduce a new problem, which we call the Split Variational 
Inequality Problem (SVIP). Let Hi and H 2 be two real Hilbert spaces. Given 
operators / : H\ — > H% and g : H 2 — > H2, a bounded linear operator A : 
Hi — y H 2 , and nonempty, closed and convex subsets C C Hi and Q C H 2 , 
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the SVIP is formulated as follows: 

find a point x* G C such that (f(x*),x — x*) > for all x G C (1.1) 

and such that 

the point y* = Ax* G Q solves (g(y*),y- y*) > for all y G Q. (1.2) 

When Looked at separately, fll.ip is the classical Variational Inequality 
Problem (VIP) and we denote its solution set by SOL(C, f). The SVIP 
constitutes a pair of VIPs, which have to be solved so that the image y* = 
Ax*, under a given bounded linear operator A, of the solution x* of the VIP 
in Hi, is a solution of another VIP in another space H 2 - 

SVIP is quite general and should enable split minimization between two 
spaces so that the image of a solution point of one minimization problem, 
under a given bounded linear operator, is a solution point of another mini- 
mization problem. Another special case of the SVIP is the Split Feasibility 
Problem (SFP) which had already been studied and used in practice as a 
model in intensity-modulated radiation therapy (IMRT) treatment planning; 
see 0CTO]. 

We consider two approaches to the solution of the SVIP. The first ap- 
proach is to look at the product space H\ x H 2 and transform the SVIP 
f ll.ip - fll.2p into an equivalent Constrained VIP (CVIP) in the product space. 
We study this CVIP and devise an iterative algorithm for its solution, which 
becomes applicable to the original SVIP via the equivalence between the 
problems. Our new iterative algorithm for the CVIP, thus for the SVIP, is 
inspired by an extension of the extragradient method of Korpelevich [22] . In 
the second approach we present a method that does not require the trans- 
lation to a product space. This algorithm is inspired by the work of Censor 
and Segal [H] and Moudafi [21] ■ 

Our paper is organized as follows. In Section [2] we present some prelim- 
inaries. In Section [3] the algorithm for the constrained VIP is presented. In 
Section H] we analyze the SVIP and present its equivalence with the CVIP 
in the product space. In Section we first present our method for solving 
the SVIP, which does not rely on any product space formulation, and then 
prove convergence. In Section [6] we present some applications of the SVIP. 
It turns out that in addition to helping us solve the SVIP, the CVIP unifies 
and improves several existing problems and methods where a VIP has to be 
solved with some additional constraints. Relations of our results to some 
previously published work are discussed in detail after Theorems 13.51 and 15 . 31 
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2 Preliminaries 



Let if be a real Hilbert space with inner product (•, •) and norm || • ||, and 
let D be a nonempty, closed and convex subset of H. We write x k — ^ x to 
indicate that the sequence converges weakly to x, and x k — > x to 

indicate that the sequence {x k }^_ Q converges strongly to x. For every point 
x G H, there exists a unique nearest point in D, denoted by Pjj(x). This 
point satisfies 

\\x - P D (x)|| < \\x - y\\ for all y G D. (2.1) 

The mapping is called the metric projection of H onto .D. We know that 
Pb is a nonexpansive operator of H onto D, i.e., 

||P D 0)-P D (j/)|| < ||rr-2/|| for all x, ye H. (2.2) 

The metric projection Pjj is characterized by the fact that Pjj (x) G D and 

(x - P D (x) , P D (x) -y)>0 for all x E H, ye D, (2.3) 

and has the property 

\\x-yf > \\x -P D (x) f + \\y-P D (x)\\ 2 for all x e H, ye D. (2.4) 

It is known that in a Hilbert space H, 

\\Xx + (1 - %|| 2 = A||x|| 2 + (1 - A)|M| 2 - A(l — A)I|a? — y\\ 2 (2.5) 

for all x,y G H and A G [0, 1]. 

The following lemma was proved in [3"2"| Lemma 3.2]. 

Lemma 2.1 Let H be a Hilbert space and let D be a nonempty, closed and 
convex subset of H. If the sequence {x k }°^ =Q C H is Fejer-monotone with 
respect to D, i.e., for every u G D, 

\\x k+1 - u|| < \\x k - u\\ for all k>0, (2.6) 

then {P D (x fc )}~ converges strongly to some z G D. 

The next lemma is also known (see, e.g., [271 Lemma 3.1]). 
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Lemma 2.2 Let H be a Hilbert space, {oik}^ =0 be a real sequence satisfying 
0<a<a k <b<l for all k > 0, and let {v k }™_ Q and {w k }™_ be two 
sequences in H such that for some a > 0, 

limsup ||v fc || < a, and limsup \\w k \\ < a. (2-7) 

k— >oo k—^oo 



If 

then 



lim \\a k v k + (1 - a k )w k \\ = a, (2.8) 

k— >oo 



lim \\v k - w k \\ = 0. (2.9) 

fc— >oo 



Definition 2.3 Let H be a Hilbert space, D a closed and convex subset of 
H, and let M : D — >■ H be an operator. Then M is said to be derniclosed 
at y G H if for any sequence {x k } k=0 in D such that x k — x E D and 
M(x k ) — > y, we have M(x) = y. 

Our next lemma is the well-known Demiclosedness Principle jl]. 

Lemma 2.4 Let H be a Hilbert space, D a closed and convex subset of H, 
and N : D — > H a nonexpansive operator. Then I — iV (I is the identity 
operator on H) is derniclosed at y G H. 

For instance, the orthogonal projection P onto a closed and convex set is 
a derniclosed operator everywhere because I — P is nonexpansive [2H page 
17]. 

The next property is known as the Opial condition [2"8"l Lemma 1]. It 
characterizes the weak limit of a weakly convergent sequence in Hilbert space. 

Condition 2.5 (Opial) For any sequence {x k }^_ Q in H that converges 
weakly to x, 

liminf \\x k — x\\ < liminf ||a; — y\\ for all y ^ x. (2-10) 

k— >oo k— >oo 

Definition 2.6 Let h : H — )■ H be an operator and let D C H. 

(i) h is called inverse strongly monotone (ISM) with constant a on 
DCHif 

(h(x) - h(y),x- y) > a\\h{x) - h(y)\\ 2 for all x,y G D. (2.11) 

(ii) h is called monotone on D C H if 

(h(x) - h(y), x -y)>0 for all x,y G D. (2.12) 
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Definition 2.7 An operator h : H H is called Lipschitz continuous 

on D C H with constant k > if 

\\h(x) — h{i/)\\ < k\\x — y\\ for all x,y G D. (2-13) 

Definition 2.8 Let S : H ^ 2 H be a point-to-set operator defined on a 
real Hilbert space H . S is called a maximal monotone operator if S is 
monotone, i.e., 

(u — v , x — y) > 0, for all u G S(x) and for all v G S(y), (2-14) 

and the graph G(S) of S, 

G(S) := {(x,u) G H x H \u G S(x)} , (2.15) 

is not properly contained in the graph of any other monotone operator. 

It is clear that a monotone operator 5* is maximal if and only if, for each 
(x, u) G H xH, (u — v, x — y) > for all (v, y) G G(S) implies that u G S(x). 

Definition 2.9 Let D be a nonempty, closed and convex subset of H. The 
normal cone of D at the point w G D is defined by 

N D (w) := {d G H | (d,y- w) < for all y G D}. (2.16) 

Let h be an a-ISM operator on D C H, let (w) be the normal cone 
of D at a point w G D, and define the following point-to-set operator: 

In these circumstances, it follows from [301 Theorem 3] that S is maximal 
monotone. In addition, G S{w) if and only if w G SOL(D, h). 
For T : H — > H, denote by Fix(T) the fixed point set of T, i.e., 

Fix(T) := {x G H \ T(x) = x}. (2.18) 

It is well-known that 

x* G SOL(C, f) <=> x* = P c {x* - Xf(x*)), (2.19) 
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i.e., x* G Fix(Pc(7 — A/)). It is also known that every nonexpansive operator 
T : H — >■ H satisfies, for all (x, y) G H x H, the inequality 

<(* - T(x)) ~(y- T(y)),T(y) - T(x)} < (l/2)||(T(x) - x) - (T(y) - y)\\ 2 

(2.20) 

and therefore we get, for all (x, y) G H x Fix(T), 

(x - T(x),y- T(x)) < (l/2)||T(x) - x\\ 2 ; (2.21) 

see, e.g., [20j Theorem 3] and [HI Theorem 1]. 

In the next lemma we collect several important properties that will be 
needed in the sequel. 

Lemma 2.10 Let D C H be a nonempty, closed and convex subset and let 
h : H — > H be an a-ISM operator on H . //AG [0, 2a], then 

(i) the operator Pd{I — A/t) is nonexpansive on D. 
If, in addition, for all x* G SOL(D, h), 

(h(x), P D (I - Xh)(x) -x*)>0 for all x G H, (2.22) 

then the following inequalities hold: 

(ii) for all x G H and q G Fix(Po(7 — \h)), 

(P D (I - Xh)(x) - x, P D (I - Xh){x) - q) < 0; (2.23) 
(Hi) for all x G H and q G Fix(Po(J — Xh)), 

\\P D (I - Xh)(x) - q\\ 2 < \\x - qf - \\P D (I - Xh)(x) - xf . (2.24) 
Proof, (i) Let x,y G H. Then 

\\P D (I - Xh)(x) - P D (I - Xh)(y)\\ 2 = \\P D {x - Xh{x)) - P D (y - Xh{y))\\ 2 

< \\x-Xh(x) - (y-Xh(y))\\ 2 
= \\(x - y) - X(h(x) - h(y))\\ 2 

= \\x — y\\ 2 — 2X(x — y, h(x) — h(y)} 
+ X 2 \\h(x) - h(y)\\ 2 

< \\x - y\\ 2 - 2Xa\\h(x) - h(y)\\ 2 
+ X 2 \\h(x) - h(y)\\ 2 

= \\ x - y f + X(X-2a)\\h(x)-h(y)\\ 2 
<\\x-y\\ 2 . (2.25) 
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(ii) Let x £ H and q £ Fix(P D (7 - Xh)). Then 



{Pd(x — Xh(x)) — x, Pd(x — Xh(x)) — q) 

= (Pd(x — Xh(x)) — x + Xh(x) — Xh(x), Pd(x — Xh(x)) — q) 

= (P D (x - Xh(x)) -{x- Xh(x)), P D (x - Xh(x)) - q) 

- X(h(x),P D {x- Xh{x))-q). (2.26) 

By (USD, (EH and f[2~22l . we get 

(P D (x - Xh{x)) - x, P D (x - Xh(x)) - q) < 0. (2.27) 

(iii) Let x £ H and q £ Fix(P D (I - Xh)). Then 

\\q -xf= \\(P D (I - Xh)(x) -x)- (P D (I - Xh)(x) - q)\\ 2 
= \\P D (I - Xh)(x) - xf + \\P D (I - Xh)(x) - qf 
- 2{P D (I - Xh)(x) - x, P D (I - Xh)(x) - q). (2.28) 

By (ii), we get 

- 2(P D (I - Xh)(x) - x, P D (I - Xh)(x) - q) > 0. (2.29) 

Thus, 

Ik - ^|| 2 > \\Pd(I - Xh)(x) - xf + \\P D (I - Xh)(x) - qf (2.30) 

or 

\\P D (I - Xh)x - qf < \\q - xf - \\P D (I - Xh)x - xf , (2.31) 
as asserted. ■ 

Equation (12.231) means that the operator Pjj(I — Xh) belongs to the class 
of operators called the T-class. This class T of operators was introduced 
and investigated by Bauschke and Combettes in [21 Definition 2.2] and by 
Combettes in [18]. Operators in this class were named directed operators 
by Zaknoon [3l] and further studied under this name by Segal |31j and by 
Censor and Segal [151 HH US]- Cegielski [61 Def. 2.1] studied these operators 
under the name separating operators. Since both directed and separating are 
key words of other, widely-used, mathematical entities, Cegielski and Censor 
have recently introduced the term cutter operators [7]. This class coincides 
with the class T v for v — 1 [19] and with the class DC P for p = —1 [M] . The 
term firmly quasi-nonexpansive (FQNE) for T-class operators was used by 
Yamada and Ogura [33] because every firmly nonexpansive (FNE) mapping 
[2H page 42] is obviously FQNE. 
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3 An algorithm for solving the constrained 
variational inequality problem 

Let / : H — )■ H, and let C and ft be nonempty, closed and convex subsets of 
H. The Constrained Variational Inequality Problem (CVIP) is: 

find x* G C n ft such that (f(x*),x - x*) > for all x G C. (3.1) 

The iterative algorithm for this CVIP, presented next, is inspired by our ear- 
lier work [TU d2] in which we modified the extragradient method of Korpele- 
vich [22]. The following conditions are needed for the convergence theorem. 

Condition 3.1 / is monotone on C . 

Condition 3.2 f is Lipschitz continuous on H with constant k > 0. 

Condition 3.3 ft n SOL(C, f) ^ 0. 

Let {Afc}^ C [a, b] for some a, b 6 (0, and let {afc}^L C [c, d] 

for some c,d E (0, 1). Then the following algorithm generates two sequences 
that converge to a point z G ft fl SOL(C, /), as the convergence theorem 
that follows shows. 

Algorithm 3.4 

Initialization: Select an arbitrary starting point x° G H . 
Iterative step: Given the current iterate x k , compute 



construct the half-space the bounding hyperplane of which supports C at 



y k = P c (x k - X k f(x k )), 



(3.2) 



T k :={wEH \ ((x k -\ k f(x k 



))-y*,«,-y*)<0}, 



(3.3) 



and then calculate the next iterate by 



x 



a k x k + (1 - a k )P n (P Tk (x k - X k f(y k ))) . 



(3.4) 
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Theorem 3.5 Let f : H — >■ H , and let C and Vt be nonempty, closed and 
convex subsets of H . Assume that Conditions \S. 1WS. § hold, and let { 



k\ 00 

J k=0 



and {y k }^ =0 be any two sequences generated by Algorithm \3.4\ with {Afc}^ C 



[a, b] for some a, b G (0, 1/k) and {afc}^ C [c, d] for some c,d G (0, 1). T/ien 
/fc =0 {y k } k=0 converge to the same point z G Q PI SOL(C, f) and 

z = lim PnnsoL(c,/)(£ fe )- (3.5) 

re— >oo 

Proof. For the special case of fixed X k = r for all /c > this theorem 
is a direct consequence of our [12, Theorem 7.1] with the choice of the non- 
expansive operator S there to be Pq. However, a careful inspection of the 
proof of [12j Theorem 7.1] reveals that it also applies to a variable sequence 
{Afcj^Q as used here. ■ 

To relate our results to some previously published works we mention two 
lines of research related to our notion of the CVIP. Takahashi and Nadezhkina 
[27] proposed an algorithm for finding a point x* G Fix(iV)nSOL(C, /), where 
iV : C — > C is a nonexpansive operator. The iterative step of their algorithm 
is as follows. Given the current iterate x k , compute 

y k = P c (x k - X k f(x h )) (3.6) 

and then 



x 



k+l 



a k x k + (1 - a k )N (P c (x k - \ k f{y k ))) . (3.7) 

The restriction Pq\c of our Pq in H3.4[) is, of course, nonexpansive, and so it 
is a special case of N in [27]. But a significant advantage of our Algorithm 
13.41 lies in the fact that we compute Px k onto a half-space in (13.41) whereas 
the authors of [27] need to project onto the convex set C. 

Bertsekas and Tsitsiklis [3, Page 288] consider the following problem in 
Euclidean space: given / : R n — )■ R n , polyhedral sets C\ C R n and Ci C R m , 
and an m x n matrix A, find a point x* G C\ such that Ax* G C2 and 

(f(x*), x-x*}>0 for all x G C x D {y \ Ay G C 2 }. (3.8) 

Denoting Q = A~ l (C2), we see that this problem becomes similar to, 
but not identical with a CVIP. While the authors of [3] seek a solution in 
SOL(Ci DO,/), we aim in our CVIP at finSOL(C, /). They propose to solve 
their problem by the method of multipliers, which is a different approach 
than ours, and they need to assume that either C\ is bounded or A T A is 
invertible, where A T is the transpose of A. 
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4 The split variational inequality problem as 
a constrained variational inequality prob- 
lem in a product space 

Our first approach to the solution of the SVIP (jl.ip — fll.2p is to look at the 
product space H = Hi x iJ 2 and introduce in it the product set D := C x Q 
and the set 

V := {x= (x,y) G H | Ax = y}. (4.1) 

We adopt the notational convention that objects in the product space are 
represented in boldface type. We transform the SVIP (jl.ip — (jl.2p into the 
following equivalent CVIP in the product space: 

Find a point x* G D PI V, such that (h(x*), x — x*) > 

for all x = (x,y) 6 D, (4.2) 

where h : H — > H is defined by 

h(x,y) = (f(x),g(y)). (4.3) 

A simple adaptation of the decomposition lemma [31 Proposition 5.7, page 
275] shows that problems f ll.ip - fll.2p and (14. 2 p are equivalent, and, therefore, 
we can apply Algorithm 13.41 to the solution of (I4.2p . 

Lemma 4.1 A point x* = (x*,y*) solves if and only if x* andy* solve 

Proof. If (x*,y*) solves (ll.ip -( ll.2p . then it is clear that (x*,y*) solves 
(14. 2p . To prove the other direction, suppose that (x*,y*) solves (14. 2p . Since 
( 14. 2 p holds for all (x, y) G D, we may take (x*,y) G D and deduce that 

(g{Ax*),y - Ax*) > for all y G Q. (4.4) 

Using a similar argument with (x,y*) G D, we get 

(f(x*),x - x*) > for all x G C, (4.5) 

which means that (x*,y*) solves (ll.ip - f|L2|) . ■ 

Using this equivalence, we can now employ Algorithm 13. 41 in order to solve 
the SVIP. The following conditions are needed for the convergence theorem. 
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Condition 4.2 f is monotone on C and g is monotone on Q. 

Condition 4.3 / is Lipschitz continuous on Hi with constant k% > and g 
is Lipschitz continuous on H 2 with constant k 2 > 0. 

Condition 4.4 V n SOL(D, h) ^ 0. 

Let {Afc}^L C [a, b] for some a,b G (0, l/«), where k = min{«i,«2}, 
and let {«fc}^ C [c,d] for some c,d G (0, 1). Then the following algorithm 
generates two sequences that converge to a point z E V H SOL(D,h), as 
the convergence theorem given below shows. 

Algorithm 4.5 

Initialization: Select an arbitrary starting point x° G H . 
Iterative step: Given the current iterate x k , compute 

y k = P D (x k -\ k h(x k )), (4.6) 

construct the half-space T k the bounding hyperplane of which supports D at 

y k , 

T k :={weH\((x k - \ k h(x h )) -y k ,w- y k ) < 0}, (4.7) 
and then calculate 

x k+1 = a k x k + (l-a k )P v (P Tk (x k - X k h(y k ))) . (4.8) 

Our convergence theorem for Algorithm 14.51 follows from Theorem 13.51 

Theorem 4.6 Consider f : H\ — > Hi and g : H 2 —> H 2 , a bounded linear 
operator A : H% — > H 2 , and nonempty, closed and convex subsets C C Hi and 



Q C H 2 . Assume that Conditions 4-2-4-4 hold, and let {x k }^_ Q and {y k }'^'_ Q 



be any two sequences generated by Algorithm \4-5\ with {Afc}^l C [a, b) for 



some a, b G (0,1/ k), where k = min{/«i, Kz}, and let {a k } k=0 C [c,d] for 
some c,d G (0,1). Then {x k } fc=Q and {y h } k=0 converge to the same point 
z G V n SOL(D, h) and 

z = lim PvnsoL(D,h)( xk )- ( 4 - 9 ) 
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The value of the product space approach, described above, depends on the 
ability to "translate" Algorithm 14.51 back to the original spaces Hi and H 2 . 
Observe that due to [29j Lemma 1.1] for x=(x,y) G D, we have Pd(x) = 
(Pc(x), Pq{i/)) and a similar formula holds for Pr k - The potential difficulty 
lies in Py of (14.81) . In the finite-dimensional case, since V is a subspace, 
the projection onto it is easily computable by using an orthogonal basis. For 
example, if U is a fc- dimensional subspace of R n with the basis {ui, u 2 , Uk}, 
then for x G R n , we have 



5 Solving the split variational inequality prob- 
lem without a product space 

In this section we present a method for solving the SVIP, which does not 
need a product space formulation as in the previous section. Recalling that 
SOL(C,f) and SOL(Q,g) are the solution sets of (11.11) and CI 1 . 2 f) . respec- 
tively, we see that the solution set of the SVIP is 



r := T(C, Q, f, g, A) := {z G SOL(C, f)\Aze SOL(Q, g)} . (5.1) 



Using the abbreviations T := Pq(I — Xg) and U := Pc(I — A/), we propose 
the following algorithm. 

Algorithm 5.1 

Initialization: Let A > and select an arbitrary starting point x° G Hi . 
Iterative step: Given the current iterate x k , compute 



where 7 G (0,1/ L), L is the spectral radius of the operator A* A, and A* is 
the adjoint of A. 

The following lemma, which asserts Fejer-monotonicity, is crucial for the 
convergence theorem. 




(4.10) 



x' 



k+i 



U(x k + 1 A*(T - I)(Ax k )) } 



(5.2) 
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Lemma 5.2 Let Hi and H 2 be real Hilbert spaces and let A : Hi — > H 2 be 
a bounded linear operator. Let f : Hi — > Hi and g : H 2 — >■ H 2 be ai-ISM 
and a 2 -ISM operators on Hi and H 2 , respectively, and set a := min{ai, a 2 }. 
Assume that T ^ and that 7 G (0,1/L). Consider the operators U = 
Pc(I — A/) and T = Pq(I — Xg) with A G [0,2a]. Then any sequence 
|x fc j fc _ , generated by Algorithm \5J\ is Fejer-monotone with respect to the 
solution set T. 

Proof. Let z G T. Then z G SOL{C, /) and, therefore, by fT2TT9|) and 
Lemma [2.10( i). we get 



\.r ! - z\\ 2 = \\U (x k + jA*(T - I){Ax k )) - z 



k+l „|| 2 _ || TT (~.k 1 _, A*/rr T \f A„k\\ J| 2 

U{z)\\ 2 

2 



= \\U (x k + jA*(T - I){Ax k )) - U{z) 
< \\x k + 1 A*(T - I)(Ax k ) -z 
= \\x k - z\\ 2 + 7 2 \\A*(T - I)(Ax 



Thus 

\\x k+l 



+ 2 1 (x k - z,A*(T - I)(Ax k )) . (5.3) 

zf < \\x k - z\f + 7 2 <(T - I)(Ax k ) } AA*(T - I)(Ax k )) 

+ 2 7 (x fc - z,A*{T - I){Ax k )) . (5.4) 

From the definition of L it follows, by standard manipulations, that 

7 2 <(T - I)(Ax k ), AA*(T - I)(Ax k )) < L7 2 <(T - I){Ax k ), (T - I){Ax k )) 

= L 1 2 \\(T-I)(Ax k )\\ 2 . (5.5) 

Denoting 9 := 27 (x k — z, A*(T — I)(Ax k )) and using f )2.2ip . we obtain 

6 = 2 7 (A{x k -z),(T- I){Ax k )) 

= 2 7 (A{x k -z) + (T- I)(Ax k ) — (T — I)(Ax k ), (T - I){Ax k )) 

= 2 7 {(T{Ax k ) - Az, (T - I){Ax k )) - \\{T - I)(Ax k )\\ 2 ^j 
< 2 7 ((1/2) \\(T - I)(Ax k )\\ 2 - \\(T - I)(Ax k " 112 



< -7 II (T-I)(Ax k ) If . (5.6) 
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Applying ( 15. 5 p and (15. 6p to (15. 4p . we see that 

\\x k+1 - z\\ 2 < \\x k - z\\ 2 + 7 (L 7 - 1) \\(T - I){Ax k )\\ 2 . (5.7) 

From the definition of 7, we get 

\\x k+1 - z\\ 2 < \\x k - z\\ 2 , (5.8) 

which completes the proof. ■ 

Now we present our convergence result for Algorithm 15.11 

Theorem 5.3 Let H\ and H 2 be real Hilbert spaces and let A : Hi — > H 2 be 
a bounded linear operator. Let f : H\ H\ and g : H 2 — > H 2 be ai-ISM 
and a 2 -ISM operators on Hi and H 2 , respectively, and set a := min{ai, a 2 }. 
Assume that 7 G (0, 1/L). Consider the operators U = Pc{I — A/) and 
T = Pq(I — \g) with X G [0,2a]. Assume further that T ^ and that, for 
all x* G SOL(C,f), 

(f(x), P C (I - Xf)(x) -x*}>0 for all x G H. (5.9) 

Then any sequence {x k } kQ , generated by Algorithm I5.il converges weakly 
to a solution point x* G T. 

Proof. Let z G V. It follows from (15.81) that the sequence — ^||}^_ 
is monotonically decreasing and therefore convergent, which shows, by ( 15. 7p . 
that, 

lim \\{T - I){Ax k )\\ = 0. (5.10) 

Fejer-monotonicity implies that {x k }^_ Q is bounded, so it has a weakly con- 
vergent subsequence {x kj }°° =0 such that x kj — x*. By the assumptions on 
A and g, we get from Lemma [2.10( i) that T is nonexpansive. Applying the 
demiclosedness of T — / at to (I5.10p . we obtain 

T(Ax*)=Ax\ (5.11) 

which means that Ax* G SOL(Q, g). Denote 

u k :=x k + 1 A*{T -I){Ax k ). (5.12) 

Then 

u k 3 = x k i + 1 A*{T - I)(Ax k i). (5.13) 
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Since x kj — ^ x*, (I5.1(jp implies that u kj — x* too. It remians to be shown 
that x* G SOL(C,f). Assume, by negation, that x* SOL(C,f), i.e., 
Ux* 7^ x*. By the assumptions on A and /, we get from Lemma [2.10( i) that 
U is nonexpansive and, therefore, U — I is demiclosed at 0. So, the negation 
assumption must lead to 

lim \\U{u k i) -u k A\ ^ 0. (5.14) 



Therefore there exists an e > and a subsequence [u k3s }^L Q of {w fcj }°^ Q such 
that 

\\U{u k ^) - u k i° || > e for all s > 0. (5.15) 
Inequality (12.241) now yields, for all s > 0, 

||?7(u*i-) -[/(^)|| 2 = ||[/<y^) -2|| 2 < ||« fcjs -^If - \\U(u k ^) -u k ^\\ 2 

< \\u k i° - zf -e 2 . (5.16) 

By arguments similar to those in the proof of Lemma 15.21 we have 

\\u k - z\\ = || (x k + 7 A*(T - I){Ax k )) - z\\ < \\x k - z\\ . (5.17) 

Since U is nonexpansive, 

H^+i - z || = \\U(u k ) - z\\ < \\u k - z\\ . (5.18) 

Combining (I5.17P and (I5.18p . we get 

_ z || < _ z || < \\ x k - z \\ , (5.19) 

which means that the sequence {x 1 , u 1 , x 2 , u 2 , . . .} is Fejer- monotone with 
respect to T. Since x kjs+1 = U(u k:is ), we obtain 

||u fe ^+i - z\\ 2 < ||w fcjs - z\\ 2 . (5.20) 

Hence {u kjs }™ =0 is also Fejer-monotone with respect to T. Now, (15.161) and 
(15TT9|) imply that 

|| u fc j s+ i _ z \^ 2 < || n fe j s _ z \^ 2 _ £ 2 f or a n s > o, (5.21) 

which leads to a contradiction. Therefore x* G SOL(C, /) and finally, x* G T. 
Since the subsequence {2^}°^ was arbitrary, we get that x k — ^ x*. ■ 
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Relations of our results to some previously published works follows. 
In [13] an algorithm for the Split Common Fixed Point Problem (SCFPP) in 
Euclidean spaces was studied. Later Moudafi (26] presented a similar result 
for Hilbert spaces. In this connection, see also |25j . 

To formulate the SCFPP, let H% and H 2 be two real Hilbert spaces. Given 
operators Ui : Hi — > Hi, i = 1,2, ... ,p, and Tj : H 2 — > H 2 , j = 1,2, ... ,r, 
with nonempty fixed point sets C iy i = 1,2, ... ,p and Qj, j = 1,2, ... ,r, 
respectively, and a bounded linear operator A : Hi — > Hi, the SCFPP is 
formulated as follows: 

find a point x* G C := n p i=1 d such that Ax* G Q := H r j= iQj. (5.22) 

Our result differs from those in [H] and [26] in several ways. Firstly, 
the spaces in which the problems are formulated. Secondly, the operators U 
and T in [T3] are assumed to be firmly quasi-nonexpansive (FQNE; see the 
comments after Lemma 12 . 101 above) . where in our case here only U is FQNE, 
while T is just nonexpansive. Lastly, Moudafi [26] obtains weak convergence 
for a wider class of operators, called demicontractive. The iterative step of 
his algorithm is 

x k+1 = (1 -a k )u k + a k U{u k ), (5.23) 

where u k := x k + ^A*{T — I)(Ax k ) for a k G (0, 1). If a k = 1, which is not 
allowed there, were possible, then the iterative step of [26J would coincide 
with that of [13]. 

5.1 A parallel algorithm for solving the multiple set 
split variational inequality problem 

We extend the SVIP to the Multiple Set Split Variational Inequality Problem 
(MSSVIP), which is formulated as follows. Let Hi and H 2 be two real Hilbert 
spaces. Given a bounded linear operator A : Hi — )• H 2 , functions fi : Hi — > 
Hi, i = 1,2, . . . ,p, and gj : H 2 — > H 2 , j = 1,2, ... ,r, and nonempty, closed 
and convex subsets Ci C Hi, Qj C H 2 for % — 1, 2, . . . ,p and j = 1,2, ... ,r, 
respectively, the Multiple Set Split Variational Inequality Problem (MSSVIP) 
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is formulated as follows: 



find a point x* G C := rf =1 Cj such that (fi(x*),x - x*) > for all x e Ci 
and for alH = 1, 2, . . . ,p, and such that 

the point y* = Ax* G Q := n- =1 Qj solves (gj(y*),y - y*) > for all y G <3j 
and for all j = 1, 2, . . . , r. 

(5-24) 

For the MSSVIP we do not yet have a solution approach which does 
not use a product space formalism. Therefore we present a simultaneous 
algorithm for the MSSVIP the analysis of which is carried out via a certain 
product space. Let \1/ be the solution set of the MSSVIP: 



* := {z G nUSOLidJt) I Az G r% =x SOL{Q h9j )}. 



(5.25) 



We introduce the spaces W\ : =H\ and := #i x H\, where r and p 
are the indices in f!5.24p . Let {oiiY i=l and {/3j}j =1 be positive real numbers. 
Define the following sets in their respective spaces: 



C: 
Q 



Hi and 



x 



%Q 



(5.26) 
(5.27) 



and the operator 
A: 



ail, 



(3 r A* 



(5.28) 



where A* stands for adjoint of A. Denote Ui 
Pq 3 (I ~ ^9j) for % = 1, 2, . . . ,p and j = 1,2,.. 
operator T : W 2 ^-W 2 by 



= P .(J- A/0 and 7} := 
r, respectively. Define the 



/ yi \ 

1)2 



\ Vp+r / 

((Ui (yi)Y 



(U p (y p )Y , (Ti (yp+i))* , • • • , (T r (y p+r )Y 



(5.29) 



where y 1 ,y 2 ,...,y P G #i and y p+ i,y p+2 , ...,y p+r G 

This leads to an SVIP with just two operators F and G and two sets 
C and Q, respectively, in the product space, when we take C—Hi, F = 0, 
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QCW 2 , G(y) = (fi(y 1 ),f 2 (y2)...,f p (yp),gi(y p+ i),g2(yp + 2),...,g r (y p+r )), 
and the operator A : Hi^-W 2 . It is easy to verify that the following equiv- 
alence holds: 

x G V if and only if Ax G Q. (5.30) 
Therefore we may apply Algorithm 15. 1\ 

x k+i = x k + 7 a*(T - I)(Ax k ) for all k > 0, (5.31) 

to the problem ( 15 . 2 6 [) — ( 15 . 2 9 [) in order to obtain a solution of the original 
MSSVIP. We translate the iterative step (15.311) to the original spaces H 1 and 
H 2 using the relation 

T(Ax) = (y^U^x), . . . , y/aJJ p (x), sffcAT^x), ^%AT r (x)Y 

(5.32) 

and obtain the following algorithm. 

Algorithm 5.4 

Initialization: Select an arbitrary starting point x° e Hi. 
Iterative step: Given the current iterate x k , compute 




(5.33) 



where 7 G (0, l/L), with L = Y7 i= i a% + Ej=i /^iPII 2 - 

The following convergence result follows from Theorem 15.31 

Theorem 5.5 Let Hi and H 2 be two real Hilbert spaces and let A : Hi — > 
H 2 be a bounded linear operator. Let /j : Hi — > Hi, i = 1,2, ... ,p, and 
gj : H 2 — > H 2 , j = 1, 2, . . . , r, be a-ISM operators on nonempty, closed and 
convex subsets Ci C Hi, Qj C H 2 for i = 1,2, ... ,p, and j = 1,2, ... ,r, 
respectively. Assume that 7 G (0, l/L) and \& 7^ 0. Set Ui := Pdi.1 — A/«) 
and Tj := Pq j (I — Xgj) for i = 1,2, ... ,p and j = 1,2, ... ,r, respectively, 
with A G [0, 2a] . If, in addition, for each i = 1,2, ... ,p and j = 1,2, ... ,r 
we have 

(fi(x),P Ci (I - Xfi)(x) - x*) >0 for all x G H (5.34) 
for all x* G SOL(d, fc) and 

(gj{x),P Q .{I - Xgj)(x) -x*) >0 for all x G H, (5.35) 
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for all x* G SOL(Ci, f,j), then any sequence {x k ^_ Q , generated by Algorithm 
\5.1\ converges weakly to a solution point x* G ^ . 

Proof. Apply Theorem 15.31 to the two-operator SVIP in the product 
space setting with U = I : H x -»■ H x , Fix £7 = C, T = T : W W, and 
FixT = Q. ■ 

Remark 5.6 Observe that conditions ( [5. ff^p and ( 15.55]) imposed on Ui and 
Tj for i — 1, 2, . . . ,p and j = 1, 2, . . . , r, respectively, in Theorem \5.b\ which 
are necessary for our treatment of the problem in a product space, ensure that 
these operators are firmly quasi-nonexpansive (FQNE). Therefore, the SVIP 
under these conditions may be considered a Split Common Fixed Point 
Problem (SCFPP), first introduced in JT^]/, with C, Q, A and T : W 2 — >■ W 2 
as above, and the identity operator I : C —¥ C . Therefore, we could also 
apply m\ Algorithm J^.lj. If, however, we drop these conditions, then the 
operators are nonexpansive, by Lemma \2.10( i) . and the result of f2b^ would 
apply. 

6 Applications 

The following problems are special cases of the SVIP. They are listed here 
because their analysis can benefit from our algorithms for the SVIP and 
because known algorithms for their solution may be generalized in the future 
to cover the more general SVIP. The list includes known problems such as the 
Split Feasibility Problem (SFP) and the Convex Feasibility Problem (CFP). 
In addition, we introduce two new "split" problems that have, to the best of 
our knowledge, never been studied before. These are the Common Variational 
Inequality Point Problem (CVIPP) and the Split Zeros Problem (SZP). 

6.1 The split feasibility and convex feasibility prob- 
lems 

The Split Feasibility Problem (SFP) in Euclidean space is formulated as 
follows: 

find a point x* such that x* G C C R n and Ax* e Q C R m , (6.1) 

where C C R n , Q C R m are nonempty, closed and convex sets, and A : R n — > 
R m is given. Originally introduced in Censor and Elfving [9j, it was later 
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used in the area of intensity-modulated radiation therapy (IMRT) treatment 
planning; see [TQl [5]. Obviously it is formally a special case of the SVIP 
obtained from fll.ip - fll.2l) by setting / = g = 0. The Convex Feasibility 
Problem (CFP) in a Euclidean space is: 

find a point x* such that x* G n^Q ^ 0, (6.2) 

where Ci, i = 1,2, . . . ,m, are nonempty closed and convex sets in R n . This, 
in its turn, becomes a special case of the SFP by taking in (16. ip n = m, 
A = I and C = n^C*. Many algorithms for solving the CFP have been 
developed; see, e.g., [TJ IT7] . Byrne [5] established an algorithm for solving 
the SFP ; called the CQ-Algorithm, with the following iterative step: 

x k+1 = P c {x k + 1 A\P Q - I)Ax k ) , (6.3) 

which does not require calculation of the inverse of the operator A, as in [9], 
but needs only its transpose A 1 . A recent excellent paper on the multiple-sets 
SFP which contains many references that reflect the state-of-the-art in this 
area is [23J. 

It is of interest to note that looking at the SFP from the point of view of 
the SVIP enables us to find the minimum- norm solution of the SFP, i.e., a 
solution of the form 

x* = argmin{||a;|| | x solves the SFP (16. ip }. (6-4) 

This is done, and easily verified, by solving ( II . 1 [) ( TT72|) with f = I and g = 0. 

6.2 The common variational inequality point problem 

The Common Variational Inequality Point Problem (CVIPP), newly intro- 
duced here, is defined in Euclidean space as follows. Let {fi}"L 1 be a family 
of functions from R n into itself and let {Ci}™ =l be nonempty, closed and 
convex subsets of R n with fl^Cj ^ 0. The CVIPP is formulatd as follows: 

find a point x* G n™ 1 Cj such that (fi(x*),x — x*) > 

for all x G Cj, i — 1,2, ... , m. (6.5) 

This problem can be transformed into a CVIP in an appropriate product 
space (different from the one in Section H]). Let R mn be the product space 
and define F : R mn R mn by 
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F (Oi, X 2 , ...,X m )*) = ((/l(xi), /mfrm))*) , (6.6) 

where Xi G i? n for alH = 1, 2, . . . , m. Let the diagonal set in R mn be 

A := {x G R mn | x={a, a, a), a G iT} (6.7) 
and define the product set 

C := n^C,. (6.8) 
The CVIPP in i? n is equivalent to the following CVIP in R mn : 

find a point x* G C n A such that (F(x*), x — x*} > 

for all = (xi, X2, x m ) G C. (6.9) 

So, this problem can be solved by using Algorithm 13.41 with Q = A. A new 
algorithm specifically designed for the CVIPP appears in [T3] . 

6.3 The split minimization and the split zeros prob- 
lems 

From optimality conditions for convex optimization (see, e.g., Bertsekas and 
Tsitsiklis [31 Proposition 3.1, page 210]) it is well-known that if F : R n -> R n 
is a continuously differentiable convex function on a closed and convex subset 
X C i? n , then x* G X minimizes F over X if and only if 

(VF(x*), x-x*)>0 for all x G X, (6.10) 

where V-F is the gradient of F. Since (16.1 Op is a VIP, we make the following 
observation. If F : R n — > R n and G : R m — >■ i? m are continuously differen- 
tiable convex functions on closed and convex subsets C C R n and Q C R m , 
respectively, and if in the SVIP we take / = VF and g = VG, then we 
obtain the following Split Minimization Problem (SMP): 

find a point x* G C such that x* = argmin{/(x) | x G C} (6-H) 

and such that 

the point y* = Ax* G Q solves y* = argmin{(yf(y) | y G Q}. (6.12) 

The Split Zeros Problem (SZP), newly introduced here, is defined as fol- 
lows. Let Hi and H 2 be two Hilbert spaces. Given operators Bi : Hi — y Hi 
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and B 2 : H 2 —> H 2 , and a bounded linear operator A : H\ — >■ 77 2 , the SZP is 
formulated as follows: 

find a point x* G 77i such that B\(x*) = and 7?2(Ax*) = 0. (6.13) 

This problem is a special case of the SVIP if A is a surjective operator. To 
see this, take in f ll.ip - fll.2p C = Hi, Q = H 2 , f — B\ and g = B 2 , and choose 
x := x*-Bi(x*) G Hi in ffTTTl) and x G Hi such that Ax := Ax* - B 2 (Ax*) G 
77 2 in (JT2}. 

The next lemma shows when the only solution of an SVIP is a solution of 
an SZP. It extends a similar result concerning the relationship between the 
(un-split) zero finding problem and the VIP. 

Lemma 6.1 Let Hi and H 2 be real Hilbert spaces, and C C Hi and Q C H 2 
nonempty, closed and convex subsets. Let Bi : Hi — > Hi and B 2 : H 2 — >■ H 2 
be a-ISM operators and let A : Hi H 2 be a bounded linear operator. 
Assume that C D {x G H x \ Bi(x) = 0} ^ and i/iai Q f] {y e H 2 \ B 2 (y) = 
0} 7^ 0, and denote 

T := r(C, Q, Bi, fi 2 , A) := G SOL(C, S x ) | Az G SOL(g, 5s)} . (6.14) 

Then, for any x* G C with Ax* G Q, x* solves A6.13\) if and only if x* G T. 

Proof. First assume that x* G C with Ax* G Q and that x* solves 
f)6.13p . Then it is clear that x* G T. In the other direction, assume that 
x* G C with Ax* G Q and that x* G T. Applying with C as D there, 
(I-XBi) (x*) G fli, for any A G (0, 2a], as x there, and <?i G CnFix(J-A-Bi), 
with the same A, as y there, we get 

_ Po (j _ ASl ) + || (/ _ xBi) (x*) - P C {I - XBi) (x*)\\ 2 

< - XBi) (x*) - gi \\ 2 , (6.15) 

and, similarly, applying (12 .4p again, we obtain 

\\q 2 - P Q (I - \B 2 ) (Ax*) || 2 + || (J - XB 2 ) (Ax*) - P Q (I - \B 2 ) (Ax*) || 2 
< ||(/-A J B 2 )(Ax*)-g 2 || 2 . (6.16) 

Using the characterization of f)2.19p . we get 

|| gi - x*f + ||(/ - \B X ) (x*) - x*|| 2 < ||(7 - ABO (x*) - gi || 2 (6.17) 
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and 



\\q 2 - Ax*\\ 2 + ||(/ - \B 2 ) {Ax*) - x*\\ 2 < - XB 2 ) (Ax*) - q 2 \\ 2 . (6.18) 

It can be seen from the proof of Lemma f2. 10l (i) that the operators I — \B\ 
and / — \B 2 are nonexpansive for every A G [0, 2a], so with q± G C R Fix(J — 
\Bi) and q 2 E Q (~) Fix(I - XB 2 ), 

- XB t ) (x*) - gi \\ 2 < \\x* - gi \\ 2 (6.19) 

and 

- XB 2 ) (Ax*) - q 2 f < \\Ax* - q 2 f . (6.20) 
Combining the above inequalities, we obtain 

Iki-^f + IK^-^i)^*)-^*!! 2 ^ Ik* -gill 2 (6.2i) 

and 

\\q 2 - Ax*f + \\(I - \B 2 ) (Ax*) - x*\\ 2 < \\Ax* - q 2 f . (6.22) 

Hence, \\(I - XB t ) (x*) - x*\\ 2 = and ||(J - \B 2 ) (Ax*) - Ax*\\ 2 = 0. Since 
A > 0, we get that Bi(x*) = and B 2 (Ax*) = 0, as claimed ■ 
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Abstract 

We propose a prototypical Split Inverse Problem (SIP) and a new 
variational problem, called the Split Variational Inequality Problem 
(SVIP), which is a SIP. It entails finding a solution of one inverse prob- 
lem (e.g., a Variational Inequality Problem (VIP)), the image of which 
under a given bounded linear transformation is a solution of another 
inverse problem such as a VIP. We construct iterative algorithms that 
solve such problems, under reasonable conditions, in Hilbert space and 
then discuss special cases, some of which are new even in Euclidean 
space. 

Keywords Constrained Variational Inequality Problem - Hilbert 
space - Inverse strongly monotone operator - Iterative method - Metric 
projection - Monotone operator - Product space - Split Inverse Prob- 
lem - Split Variational Inequality Problem - Variational Inequality 
Problem 
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1 Introduction 



In this paper we introduce a new problem, which we call the Split Variational 
Inequality Problem (SVIP). The connection of SVIP to inverse problems and 
many relevant references to earlier work are presented in Section El Let 
Hi and H 2 be two real Hilbert spaces. Given operators / : Hi — y Hi and 
g : H 2 — > Hi, a bounded linear operator A : H\ — >■ H 2 , and nonempty, closed 
and convex subsets C C Hi and Q C if 2 , the SVIP is formulated as follows: 

find a point i*6C such that (f(x*),x — x*) > for all x G C (1-1) 

and such that 

the point y* = Ax* G Q and solves (g(y*),y — y*) > for all y E Q. (1.2) 

When looked at separately, (11. ip is the classical Variational Inequality 
Problem (VIP) and we denote its solution set by SOL{C, f). The SVIP 
constitutes a pair of VIPs, which have to be solved so that the image y* = 
Ax*, under a given bounded linear operator A, of the solution x* of the VIP 
in Hi, is a solution of another VIP in another space H 2 . 

SVIP is quite general and should enable split minimization between two 
spaces so that the image of a solution point of one minimization problem, 
under a given bounded linear operator, is a solution point of another mini- 
mization problem. Another special case of the SVIP is the Split Feasibility 
Problem (SFP) which had already been studied and used in practice as a 
model in intensity-modulated radiation therapy (IMRT) treatment planning; 
see [II1II5]. 

We consider two approaches to the solution of the SVIP. The first ap- 
proach is to look at the product space Hi x H 2 and transform the SVIP 
( ll.ip - (jl.2p into an equivalent Constrained VIP (CVIP) in the product space. 
We study this CVIP and devise an iterative algorithm for its solution, which 
becomes applicable to the original SVIP via the equivalence between the 
problems. Our new iterative algorithm for the CVIP, thus for the SVIP, is 
inspired by an extension of the extragradient method of Korpelevich [SU] ■ In 
the second approach we present a method that does not require the trans- 
lation to a product space. This algorithm is inspired by the work of Censor 
and Segal [2Q] and Moudafi [M]. 

Our paper is organized as follows. The connection of SVIP to inverse 
problems and many relevant references to earlier work are presented in Sec- 
tion |2j In Section [3] we present some preliminaries. In Section |4]the algorithm 
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for the constrained VIP is presented. In Section we analyze the S VIP and 
present its equivalence with the CVIP in the product space. In Section O 
we first present our method for solving the SVIP, which does not rely on 
any product space formulation, and then prove convergence. In Section [7] 
we present some applications of the SVIP. It turns out that in addition to 
helping us solve the SVIP, the CVIP unifies and improves several existing 
problems and methods where a VIP has to be solved with some additional 
constraints. Further relations of our results to previously published work are 
discussed in detail after Theorems 14.51 and 16.31 

2 The split variational inequality problem as 
a methodology for inverse problems 

Following the case which has already been studied and used in practice as a 
model in intensity-modulated radiation therapy (IMRT) treatment planning; 
see [TT[ [T5]. a prototypical Split Inverse Problem (SIP) concerns a model in 
which there are two spaces X and Y and there is given a bounded linear 
operator A : X — » Y. Additionally, there are two inverse problems involved, 
one inverse problem denoted IPi formulated in the space X and another 
inverse problem IP 2 formulated in the space Y. The Split Inverse Problem 
(SIP) is the following: 



Many models of inverse problems can be cast in this framework by choos- 
ing different inverse problems for IPi and IP2. The Split Convex Feasibility 
Problem (SCFP) first published in Numerical Algorithms [14j is the first 
instance of a SIP in which the two problems IPi and IP2 are CFPs each. 
This was used for solving an inverse problem in radiation therapy treatment 
planning in [15]. More work on the SCFP can be found in [6J [151 EH EU 
[381 SQl S21 Hi SHI ill S9]. Two candidates for IPi and IP 2 that come to 
mind are the mathematical models of the Convex Feasibility Problem (CFP) 
and the problem of constrained optimization. In particular, the CFP for- 
malism is in itself at the core of the modeling of many inverse problems in 



find a point x* G X that solves IPi 

such that 
the point y* = Ax* G Y solves IP 2 
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(2.1) 



(2.2) 
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various areas of mathematics and the physical sciences; see, e.g., [10] and ref- 
erences therein for an early example. Over the past four decades, the CFP 
has been used to model significant real-world inverse problems in sensor net- 
works, in radiation therapy treatment planning, in resolution enhancement, 
in wavelet-based denoising, in antenna design, in computerized tomography, 
in materials science, in watermarking, in data compression, in demosaicking, 
in magnetic resonance imaging, in holography, in color imaging, in optics 
and neural networks, in graph matching and in adaptive filtering, see [T2J for 
exact references to all the above. More work on the CFP can be found in 

umm- 

It is therefore natural to investigate if other inversion models for IPi and 
IP 2 , besides CFP, can be embedded in the SIP methodology. For example, 
CFP in the space X and constrained optimization in the space Yl In this 
paper we make a step in this direction by formulating a SIP with Variational 
Inequality Problems (VIP) in each of the two spaces of the SIP. Since, as 
is well-known, both CFP and constrained optimization are special cases of 
VIP, our newly-proposed SVIP covers the earlier SCFP and allows for new 
SIP situations. Such new situations are described in Section [7] below. 

3 Preliminaries 

Let if be a real Hilbert space with inner product (-, ■) and norm || ■ ||, and 
let D be a nonempty, closed and convex subset of H. We write x k — x to 
indicate that the sequence {x k }^L converges weakly to x, and x k — > x to 
indicate that the sequence {x k }^_ Q converges strongly to x. For every point 
x G H, there exists a unique nearest point in D, denoted by Pjj(x). This 
point satisfies 

\\x - P D (x)\\ < \\x - y\\ for all y G D. (3.1) 

The mapping Pd is called the metric projection of H onto D. We know that 
Pd is a nonexpansive operator of H onto D, i.e., 

\\P D (x)-P D (y)\\<\\x-y\\ for all x, y G H. (3.2) 

The metric projection Pd is characterized by the fact that Pd (x) G D and 

(x - P D (x) , P D (x) - y) > for all x G H, ye D, (3.3) 
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and has the property 

\\x-y\\ 2 > \\x- P D (x)\\ 2 + \\y- P D (x)\\ 2 for all x G H, y G D. (3.4) 

It is known that in a Hilbert space H, 

\\\x + (1 - \)y\\ 2 = X\\x\\ 2 + (1 - A)|M| 2 - A(l - X)\\x - y\\ 2 (3.5) 

for all x,y G H and A G [0, 1]. 

The following lemma was proved in [421 Lemma 3.2]. 

Lemma 3.1 Let H be a Hilbert space and let D be a nonempty, closed and 
convex subset of H. If the sequence {x k }^_ C H is Fejei — monotone with 
respect to D, i.e., for every u G D, 

\\x k+1 - u\\ < \\x k - u|| for all k > 0, (3.6) 

then {P D {x k )}™_ converges strongly to some z G D. 

The next lemma is also known (see, e.g., [351 Lemma 3.1]). 

Lemma 3.2 Let H be a Hilbert space, {afcjfcLo ^ e a rea ^ seauence satisfying 
0<a<ak<b<l for all k > 0, and let {v k ^_ Q and {w k ^_ Q be two 
sequences in H such that for some a > 0, 

limsup ||w fc || < a, and limsup||w fc || < a. (3.7) 

k— >oo k— >oo 

If 

lim \\a k v k + (1 -a k )w k \\ = a, (3.8) 

k— >oo 

then 

lim \\v k -w k \\ =0. (3.9) 

k— >oo 

Definition 3.3 Let H be a Hilbert space, D a closed and convex subset of 
H, and let M : D — ^ H be an operator. Then M is said to be derniclosed 
at y G H if for any sequence {x k }^_ Q in D such that x k — x G D and 
M(x k ) — > y, we have M(x) = y. 

Our next lemma is the well-known Demiclosedness Principle jl]. 



5 



Lemma 3.4 Let H be a Hilbert space, D a closed and convex subset of H, 
and N : D — )■ H a nonexpansive operator. Then I — N (I is the identity 
operator on H) is demiclosed at y G H. 

For instance, the orthogonal projection P onto a closed and convex set is 
a demiclosed operator everywhere because I — P is nonexpansive page 
17]- 

The next property is known as the Opial condition [36l Lemma 1]. It 
characterizes the weak limit of a weakly convergent sequence in Hilbert space. 

Condition 3.5 (Opial) For any sequence {x k }^_ in H that converges 
weakly to x, 

liminf \\x k — x\\ < liminf \\x — y\\ for all y ^ x. (3.10) 

k— Yoc k— >oo 

Definition 3.6 Let h : H — )■ H be an operator and let D C H. 

(i) h is called inverse strongly monotone (ISM) with constant a on 
DCH if 

(h(x) - h(y),x-y) > a\\h(x) - %)|| 2 for allx,y G D. (3.11) 

(ii) h is called monotone on D C H if 

(h{x) - h(y),x-y) > for all x,y G D. (3.12) 

Definition 3.7 An operator h : H — )■ H is called Lipschitz continuous 

on D C H with constant k > if 

\\h(x) — h(y)\\ < k\\x — y\\ for all x,y G D. (3.13) 

Definition 3.8 Let S : H 2 H be a point-to-set operator defined on a 
real Hilbert space H . S is called a maximal monotone operator if S is 
monotone, i.e., 

(u — v, x — y) > 0, for all u G S(x) and for all v G S(y), (3.14) 
and the graph G(S) of S, 

G(S) := {(x,u) G H x H \u G S(x)} , (3.15) 
is not properly contained in the graph of any other monotone operator. 
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It is clear that a monotone operator S is maximal if and only if, for each 
(x, u) G Hx H, (u — v, x — y) > for all (v, y) G G(S) implies that u G S(x). 

Definition 3.9 Let D be a nonempty, closed and convex subset of H. The 
normal cone of D at the point w G D is defined by 

N D (w) := {d G H | (d,y- w) < for all y G D}. (3.16) 

Let h be an a-ISM operator on D C H, define the following point-to-set 
operator: 

h(w) + N D (w), we C, , u) 

0, w £ c. y ■ ) 

In these circumstances, it follows from [SHI Theorem 3] that S is maximal 
monotone. In addition, G S(w) if and only if w G SOL(D, h). 
For T : H — > H, denote by Fix(T) the fixed point set of T, i.e., 

Fix(T) := {x G H | T(x) = x}. (3.18) 

It is well-known that 

x* G SOL(D, h) x* = P D (x* - \h(x*)), (3.19) 

i.e., x* G Fix(Po(J — Xh)). It is also known that every nonexpansive operator 
T : H H satisfies, for all (x, y) G H x H, the inequality 

((* - T(x)) - (y - T(y)), T(y) - T(x)> < (1/2) || (T(x) - x) - (T(y) - y) f 

(3.20) 

and therefore we get, for all (x, y) £ H x Fix(T), 

(x-T(x),y-T(x)) < (l/2)||T(x)-x|| 2 ; (3.21) 

see, e.g., [26J Theorem 3] and [251 Theorem 1]. 

In the next lemma we collect several important properties that will be 
needed in the sequel. 

Lemma 3.10 Let D C H be a nonempty, closed and convex subset and let 
h : H — > H be an a-ISM operator on H . If A G [0, 2a], then 

(i) the operator Pd(I — Xh) is nonexpansive on D. 
If, in addition, for all x* G SOL(D, h), 

(h{x), P D (I - Xh){x) -x*)>0 for all x G H, (3.22) 
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then the following inequalities hold: 

(ii) for all x G H and q G Fix(Po(J — Xh)), 

(P D (I - \h){x) - x, P D (I - Xh){x) - q) < 0; (3.23) 

(Hi) for all x G H and q G Fix(Po(J — Xh)), 

\\P D (I - Xh)(x) - qf < \\x - qf - \\P D (I - Xh)(x) -xf. (3.24) 

Proof, (i) Let x,y G H. Then 

\\P D (I - Xh)(x) - P D (I - Xh)(y)\\ 2 = \\P D (x - Xh(x)) - P D (y - Xh(y))\\ 2 

< \\x-Xh(x) - (y-Xh(y))\\ 2 
= \\(x - y) - X(h(x) - h(y))f 

= \\ x ~ V\\ 2 - 2X ( X - V, h(x) - h(y)} 
+ X 2 \\h(x) - h(y)\\ 2 

< \\ x - y \\i-2Xa\\h(x)-h(y)\\ 2 
+ X 2 \\h(x) - h(y)\\ 2 

= \\ x -y\\ 2 + X(X-2a)\\h(x)-h(y)\\ 2 
<||x-y|| 2 . (3.25) 

(ii) Let x G H and q G Fix(P D (I - Xh)). Then 

(Pd(x — Xh(x)) — x, Pd(x — Xh(x)) — q) 

= (Pd(% — Xh(x)) — x + Xh(x) — Xh(x), Pd(x — Xh(x)) — q) 

= (Pd(x — Xh(x)) — (x — Xh(x)), Pd(x — Xh(x)) — q) 

-X{h(x),P D (x-Xh(x))-q). (3.26) 

By (I3T311 . (JSHD and we get 

(P D (x - Xh(x)) - x, P D (x - Xh(x)) - q) < 0. (3.27) 

(iii) Let x G H and q G Fix(P D (I - Xh)). Then 

\\q - x\\ 2 = \\(P D (I - Xh)(x) -x)- (P D (I - Xh)(x) - q)\\ 2 
= \\P D (I - Xh)(x) - x\\ 2 + \\P D (I - Xh)(x) - qf 
- 2(P D (I - Xh)(x) - x, P D (I - Xh)(x) - q). (3.28) 
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By (ii), we get 

- 2(P D (I - Xh)(x) - x, P D (I - Xh)(x) -q)>0. (3.29) 

Thus, 

\\q - xf > \\P D (I - Xh)(x) - xf + \\P D (I - Xh)(x) - qf (3.30) 

or 

\\P D (I - Xh)(x) - qf < \\q - xf - \\P D (I - Xh)(x) -xf, (3.31) 
as asserted. ■ 

Observe that, under the additional condition ( I3.22p . Equation ( I3.23P 
means that the operator Pd{I — Xh) belongs to the class of operators called 
the T-class. This class T of operators was introduced and investigated by 
Bauschke and Combettes in [21 Definition 2.2] and by Combettes in [24]. 
Operators in this class were named directed operators by Zaknoon [47] and 
further studied under this name by Segal [4T] and by Censor and Segal 
[211 [20| [22]. Cegielski [H Def. 2.1] studied these operators under the name 
separating operators. Since both directed and separating are key words of 
other, widely-used, mathematical entities, Cegielski and Censor have recently 
introduced the term cutter operators [9]. This class coincides with the class 
P v for v — 1 [25] and with the class DC P for p = — 1 [32] . The term firmly 
quasi-nonexpansive (FQNE) for T-class operators was used by Yamada and 
Ogura [45] because every firmly nonexpansive (FNE) mapping [28[ page 42] 
is obviously FQNE. 

4 An algorithm for solving the constrained 
variational inequality problem 

Let / : H — >■ H, and let C and Q be nonempty, closed and convex subsets of 
H. The Constrained Variational Inequality Problem (CVIP) is: 

find x* E C n tt such that (f{x*),x - x*) > for all x E C. (4.1) 

The iterative algorithm for this CVIP, presented next, is inspired by our ear- 
lier work [161 ELY] i n which we modified the extragradient method of Korpele- 
vich [5U]. The following conditions are needed for the convergence theorem. 
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Condition 4.1 / is monotone on C. 

Condition 4.2 f is Lipschitz continuous on H with constant k > 0. 

Condition 4.3 £1 n SOL(C, f) ^ 0. 

Let {Xk}kLo c [ a 5 b] for some a, b G (0, and let {afc}^L c t c > ^ 

for some c,d £ (0, 1). Then the following algorithm generates two sequences 
that converge to a point z G fi fl SOL(C, /), as the convergence theorem 
that follows shows. 

Algorithm 4.4 

Initialization: Select an arbitrary starting point x° G H . 
Iterative step: Given the current iterate x h , compute 

y k = P c (x k -X k f(x k )), (4.2) 

construct the half-space T k the bounding hyperplane of which supports C at 

y k , 

T k :={weH\( (x k - \ k f(x k )) -y k ,w- y k ) < 0}, (4.3) 
and then calculate the next iterate by 

x fc+1 = ak x k + (1 - a k )P n (P Tk (x k - X k f(y k ))) . (4.4) 

Theorem 4.5 Let f : H — )■ H , and let C and Q be nonempty, closed and 
convex subsets of H. Assume that Conditions \4-l\^4^ hold, and let {x k } k _ Q 
and {?/ fc }^l be any two sequences generated by Algorithm \4-4\ with {Afc}^L C 



[a, b] for some a, b G (0, and {&k}kLo C [c, d] for some c,d G (0, 1). TTien 
{x fc } fc _ Q and {y fc } fc _ converge weakly to the same point z G f2 fl SOL(C, f) 
and 

z = lim Pnnsoz,(c,/)(z fe )- (4.5) 

Proof. For the special case of fixed X k = t for all k > this theorem 
is a direct consequence of our [17, Theorem 7.1] with the choice of the non- 
expansive operator S there to be Pq. However, a careful inspection of the 
proof of [T71 Theorem 7.1] reveals that it also applies to a variable sequence 
{Afc}^ as used here. ■ 

To relate our results to some previously published works we mention two 
lines of research related to our notion of the CVIP. Takahashi and Nadezhkina 
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[55] proposed an algorithm for finding a point x* G Fix(iV)nSOL(C, /), where 
N : C — » C is a nonexpansive operator. The iterative step of their algorithm 
is as follows. Given the current iterate x k , compute 

y k = P c (x k - X k f(x k )) (4.6) 

and then 

x k ^ = akX k + (1 - ak )N (P c (x k - X k f(y k ))) . (4.7) 

The restriction Pn|c of our in (I4.4p is, of course, nonexpansive, and so it 
is a special case of N in [35]. But a significant advantage of our Algorithm 
14.41 lies in the fact that we compute Px k onto a half-space in (14.41) whereas 
the authors of [35J need to project onto the convex set C. Various ways 
have been proposed in the literature to cope with the inherent difficulty of 
calculating projections (onto closed convex sets) that do not have a closed- 
form expression; see, e.g., He, Yang and Duan [2H], or [TS] . 

Bertsekas and Tsitsiklis [3] Page 288] consider the following problem in 
Euclidean space: given / : R n — > R n , polyhedral sets C\ C R n and C 2 C R m , 
and an m x n matrix A, find a point x* G C\ such that Ax* G Ci and 

(f(x*),x- x*} > for all x G d n {y \ Ay G C 2 }. (4.8) 

Denoting Q = A~ l (C2), we see that this problem becomes similar to, 
but not identical with a CVIP. While the authors of [3] seek a solution in 
SOL(Ci HQ, f), we aim in our CVIP at fiflSOL(C, /). They propose to solve 
their problem by the method of multipliers, which is a different approach 
than ours, and they need to assume that either C\ is bounded or A 1 A is 
invertible, where A 1 is the transpose of A. 

5 The split variational inequality problem as 
a constrained variational inequality prob- 
lem in a product space 

Our first approach to the solution of the SVIP (Jl.ip - fll.2p is to look at the 
product space H = Hi x H 2 and introduce in it the product set D := C x Q 
and the set 

V := {x = (x, y) EH \ Ax = y}. (5.1) 
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We adopt the notational convention that objects in the product space are 
represented in boldface type. We transform the SVIP fll.ip - fll.2p into the 
following equivalent CVIP in the product space: 

Find a point x* £ D D V, such that (h(x*), x — x*} > 

for all x = (x, y) £ D, (5.2) 

where h : H — > H is defined by 

h(x,y) = (f(x),g(y)). (5.3) 

A simple adaptation of the decomposition lemma [21 Proposition 5.7, page 
275] shows that problems f ll.ip - fll.2p and f )5.2p are equivalent, and, therefore, 
we can apply Algorithm 14.41 to the solution of (15. 2p . 

Lemma 5.1 A point x* = (x*,y*) solves Il5.ty) if and only if x* andy* solve 

Proof. If (x*,y*) solves f ll.ip -f ll.2p . then it is clear that (x*,y*) solves 
( 15. 2p . To prove the other direction, suppose that (x*,y*) solves (15. 2p . Since 
(15 .2p holds for all (x, y) £ D, we may take (x*, y) £ D and deduce that 

(g(Ax*), y - Ax*) > for all y £ Q. (5.4) 

Using a similar argument with (x,y*) £ D, we get 

(/«), x - x*) > for all x £ C, (5.5) 

which means that (x*,y*) solves f ll.ip - fll.2p . ■ 

Using this equivalence, we can now employ Algorithm I4.4l in order to solve 
the SVIP. The following conditions are needed for the convergence theorem. 

Condition 5.2 / is monotone on C and g is monotone on Q. 

Condition 5.3 f is Lipschitz continuous on Hi with constant K\ > and g 
is Lipschitz continuous on H2 with constant K2 > 0. 

Condition 5.4 V n SOL(D, h) ^ 0. 
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Let {Afc}^L C [a, b] for some a, b G (0, l/«), where k = min{/«i, k 2 }> 
and let {afc}^L c [ c > ^1 ^ or some c,d E (0, 1). Then the following algorithm 
generates two sequences that converge to a point z G V fl SOL(D,h), as 
the convergence theorem given below shows. 

Algorithm 5.5 

Initialization: Select an arbitrary starting point x° £ H . 
Iterative step: Given the current iterate x k , compute 

y k = P D (x k -X k h(x k )), (5.6) 

construct the half-space T k the bounding hyperplane of which supports D at 

y k , 

T k :={weH\( (x k - X k h(x k )) ~y\w- y k ) < 0}, (5.7) 
and then calculate 

x k+1 = a k x k + (1 - a k )P v (P Tk {x k - X k h(y k ))) . (5.8) 

Our convergence theorem for Algorithm 15.51 follows from Theorem 14.51 

Theorem 5.6 Consider f : Hi — > Hi and g : H2 — > H2, a bounded linear 
operator A : Hi — > H2, and nonempty, closed and convex subsets C C Hi and 



Q C H2- Assume that Conditions \5.^ 5.4 hold, and let {x k ^_ and {j/ fe }^° 



k=0 l** i k=0 

be any two sequences generated by Algorithm 15.51 with {Afc}^ C [a, b] for 
some a,b G (0,1/k), where k = min{Ki,K 2 }? an d ^ { a k}kL C [c,d] for 
some c,d G (0, 1). Then {x k } k _ and {y k } k _ Q converge weakly to the same 
point z G V n SOL(D, h) and 

z = lim PvnsoL(D,h)(x k ). (5.9) 

The value of the product space approach, described above, depends on the 
ability to "translate" Algorithm 15.51 back to the original spaces Hi and Hi- 
Observe that due to j3?l Lemma 1.1] for x=(x,y) G D, we have Pd(x) = 
(Pc(x), Pq(v)) and a similar formula holds for Pr k - The potential difficulty 
lies in Py of (|5.8p . In the finite-dimensional case, since V is a subspace, 
the projection onto it is easily computable by using an orthogonal basis. For 
example, if U is a k- dimensional subspace of R n with the basis {ui, U2, u k }, 
then for x G R n , we have 



i=l 



^— ' Hit;"- 1 
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6 Solving the split variational inequality prob- 
lem without a product space 

In this section we present a method for solving the SVIP, which does not 
need a product space formulation as in the previous section. Recalling that 
SOL(C,f) and SOL(Q,g) are the solution sets of (11.11) and (ll.2p . respec- 
tively, we see that the solution set of the SVIP is 

T := r(C, Q, f, g, A) := {z G SOL(C, f)\AzE SOL(Q, g)} . (6.1) 

Using the abbreviations T := Pq(I — Xg) and U := Pc{I — Xf), we propose 
the following algorithm. 

Algorithm 6.1 

Initialization: Let A > and select an arbitrary starting point x° G Hi. 
Iterative step: Given the current iterate x k , compute 

x k+1 = U{x k + -fA*{T - I){Ax k )), (6.2) 

where 7 G (0, 1/L), L is the spectral radius of the operator A* A, and A* is 
the adjoint of A. 

The following lemma, which asserts Fejer-monotonicity, is crucial for the 
convergence theorem. 

Lemma 6.2 Let Hi and H 2 be real Hilbert spaces and let A : Hi — y H 2 be 
a bounded linear operator. Let f : Hi — > Hi and g : H 2 — > Hi be ct\-ISM 
and a 2 -ISM operators on Hi and H 2 , respectively, and set a := min{«i, a 2 }. 
Assume that T 7^ and that 7 G (0, 1/L). Consider the operators U = 
Pc{I — A/) and T = Pq(I — Xg) with X G [0,2a]. Then any sequence 
{x k } k _ Q , generated by Algorithm \6.1\ is Fejer-monotone with respect to the 
solution set T. 

Proof. Let z G T. Then z G SOL(C, f) and, therefore, by fl3T9|) and 
Lemma l3.10( i). we get 

-z\\ 2 =\\U (x k + ~/A*{T - I){Ax k )) - z\\ 2 

= \\U (x k + 1 A*{T - I){Ax k )) - U{z)\\ 2 

< \\x k + -fA*{T - I){Ax k ) -z\\ 2 

= \\x k - z\\ 2 + -f 2 \\A*(T - I)(Ax k )\\ 2 

+ 2 1 (x k -z,A*{T-I){Ax k )). (6.3) 
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Thus 

\\x k+1 - z\\ 2 < \\x k - z\\ 2 + 7 2 <(T - I)(Ax k ), AA*(T - I){Ax k )) 

+ 2 7 (x k -z,A*(T-I) (Ax k ) ). (6.4) 

From the definition of L it follows, by standard manipulations, that 
7 2 <(T - I)(Ax k ), AA*(T - I)(Ax k )) < L7 2 <(T - I)(Ax k ), (T - I)(Ax k )) 

= L^ 2 \\(T - I)(Ax k )\\ 2 . (6.5) 

Denoting 6 := 27 — z, A*(T — I){Ax k )) and using ( I3.2ip . we obtain 

= 2 7 (A(x k -z),(T- I){Ax k )) 

= 2 7 (A(x k - Z ) + (T- I){Ax k ) — (T — I){Ax k ), (T - I){Ax k )) 

= 2 7 {{T{Ax k ) - Az, (T - I){Ax k )) -\\(T- I)(Ax k )\\ 2 ) 

< 2 7 ((1/2) || (T - I){Ax k ) || 2 - || (T - I){Ax k ) || 2 ) 

< -7||(T-/)(Ax fc )|| 2 . (6.6) 

Applying f )6.5p and (16. 6p to (16 .4p . we see that 

||x fe+1 - z\\ 2 < \\x k - z\\ 2 + 7 (L 7 - 1) \\{T - I)(Ax k )\\ 2 . (6.7) 

From the definition of 7, we get 

||x fc+1 -z|| 2 < ||a; fc -^|| 2 , (6.8) 

which completes the proof. ■ 

Now we present our convergence result for Algorithm 16.11 

Theorem 6.3 Let Hi and H 2 be real Hilbert spaces and let A : Hi — > H 2 be 
a bounded linear operator. Let f : Hi — > Hi and g : H 2 — >■ H 2 be ai-ISM 
and a 2 -ISM operators on Hi and H 2 , respectively, and set a := min{ai, a 2 }. 
Assume that 7 G (0, 1/L). Consider the operators U = Pc{I — A/) and 
T = Pq(I — Xg) with A G [0,2a]. Assume further that T 7^ and that, for 
allx* G SOL(CJ), 

(f(x), P C (I - Xf)(x) -x*}>0 for all x G H x . (6.9) 

Then any sequence {x k ^_ Q , generated by Algorithm \ 6.1l converges weakly 
to a solution point x* G T. 
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oc 
k=0 



Proof. Let z G T. It follows from ( 16. 8 p that the sequence {\\x k — z\\} 
is monotonically decreasing and therefore convergent, which shows, by (16 Tp 
that, 

lim \\(T - I)(Ax k )\\ = 0. (6.10) 

Fejer-monotonicity implies that {x k }^_ Q is bounded, so it has a weakly con- 
vergent subsequence {x fcj }°^ such that x kj — x* . By the assumptions on 
A and g, we get from Lemma I3.10( i) that T is nonexpansive. Applying the 
demiclosedness of T — / at to (I6.10p . we obtain 

T(Ax*)=Ax* } (6.11) 

which means that Ax* G SOL(Q, g). Denote 



u 



k — x k + 1 A*{T - I)(Ax k ). (6.12) 



Then 

u k * = x h + 7 A*(T - J)(Ar fc 0. (6.13) 

Since x fcj — ^ x*, (I6.10p implies that u kj — x* too. It remains to be shown 
that x* e SOL(C,f). Assume, by negation, that x* SOL(C,f), i.e., 
Ux* 7^ x*. By the assumptions on A and /, we get from Lemma [3.10( i) that 
U is nonexpansive and, therefore, U — I is demiclosed at 0. So, the negation 
assumption must lead to 

lim \\U(u k >) - u kj \\ ^ 0. (6.14) 



Therefore, there exists an e > and a subsequence {w fcjs }^ of {u kj }°°_ Q 
such that 

||l/(u fei *) - u k ^ || > e for all s > 0. (6.15) 

Condition (16. 9p justifies the use of Lemma [3.101 by supplying (I3.22p . There- 
fore, inequality ( I3.24p now yields, for all s > 0, 

\\U(u k *') - U{z)\\ 2 = \\U(u k i°) - zf < \\u k i° - zf - \\U{u k i°) -U k i»\f 

< \\u k i° -zf -e 2 . (6.16) 



By arguments similar to those in the proof of Lemma I6.2[ we have 

\\u k - z\\ = || (x k + 7 A*(T - I){Ax k )) - z\\ < \\x k - z\\ . (6.17) 
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Since U is nonexpansive, 

\\x k+1 - z\\ = \\U(u k ) - z\\ < \\u k - z\\ . (6.18) 

Combining f 16 . 1 T|) and f)6.18p . we get 

\\x k+1 - z\\ < \\u k - z\\ < \\x k - z\\ , (6.19) 

which means that the sequence {x 1 , u 1 , x 2 , u 2 , . . .} is Fejer-monotone with 
respect to T. Since x kis + 1 = U(u kjs ), we obtain 

\\ u k is+i _^|| 2 < - z\\ 2 . (6.20) 

Hence {u kja }^ } _ Q is also Fejer-monotone with respect to T. Now, (16.161) and 
(16TT9|) imply that 

|| M fc Js+ i - z \\ 2 < \\u k ^ - z\\ 2 - e 2 for all s > 0, (6.21) 

which leads to a contradiction. Therefore x* G SOL(C, /) and finally, x* G T. 
Since the subsequence {^ fcj }°^ was arbitrary, we get that x k — ^ x*. m 

Relations of our results to some previously published works follows. 
In [20] an algorithm for the Split Common Fixed Point Problem (SCFPP) in 
Euclidean spaces was studied. Later Moudafi [31] presented a similar result 
for Hilbert spaces. In this connection, see also [33]. 

To formulate the SCFPP, let Hi and H2 be two real Hilbert spaces. Given 
operators Ui : Hi — > Hi, % = 1,2, ... ,p, and Tj : H 2 — > H 2 , j = 1,2, ... ,r, 
with nonempty fixed point sets Cj, i = 1,2, ... ,p, and Qj, j = 1,2, ... ,r, 
respectively, and a bounded linear operator A : Hi — > H 2 , the SCFPP is 
formulated as follows: 

find a point x* G C := n p i=1 d such that Ax* G Q := H r j= iQj. (6.22) 

Our result differs from those in [20] and [31] in several ways. Firstly, 
the spaces in which the problems are formulated. Secondly, the operators U 
and T in [20] are assumed to be firmly quasi-nonexpansive (FQNE; see the 
comments after Lemma T3. 101 above) . where in our case here only U is FQNE, 
while T is just nonexpansive. Lastly, Moudafi [31] obtains weak convergence 
for a wider class of operators, called demicontractive. The iterative step of 
his algorithm is 

x k+1 = {l-a k )u k + a k U{u k ), (6.23) 

where u k := x k + ^A*(T — I)(Ax k ) for a k G (0, 1). If a k = 1, which is not 
allowed there, were possible, then the iterative step of [34J would coincide 
with that of [2Q]. 
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6.1 A parallel algorithm for solving the multiple set 
split variational inequality problem 

We extend the SVIP to the Multiple Set Split Variational Inequality Problem 
(MSSVIP), which is formulated as follows. Let Hi and H 2 be two real Hilbert 
spaces. Given a bounded linear operator A : Hi — >■ H 2 , functions f\ : Hi — > 
Hi, i = 1,2, ... ,p, and gj : H 2 — > H 2 , j = 1,2, ... ,r, and nonempty, closed 
and convex subsets Cj C Hi, Qj C Hi for % = 1, 2, . . . , p and j = 1,2, ... ,r, 
respectively, the Multiple Set Split Variational Inequality Problem (MSSVIP) 
is formulated as follows: 

find a point x* G C := nf =1 C, such that (fi(x*),x — x*) > for all x G Ci 
and for alH = 1, 2, . . . ,p, and such that 

the point y* = Ax* G Q := ri r i=1 Qj solves (gj(y*),y - y*) > for all y G 
and for all j = 1,2, . . . ,r. 

(6.24) 

For the MSSVIP we do not yet have a solution approach which does 
not use a product space formalism. Therefore we present a simultaneous 
algorithm for the MSSVIP the analysis of which is carried out via a certain 
product space. Let \P be the solution set of the MSSVIP: 

# := {z g r$ =1 soL{Ci,fi) I a? g n^OL^-, <?,-)}. (6.25) 

We introduce the spaces Wi : =i?i and := Hf x flj, where r and p 
are the indices in (16.24)) . Let {oti} v i=l and {/3j}J =1 be positive real numbers. 
Define the following sets in their respective spaces: 

C: = Hi and (6.26) 

Q = (n V^CiJ x |j] v^QiJ , (6.27) 

and the operator 

A: = (v^I, . . . , ^T V I, ^%A*, y/frA*y, (6.28) 

where A* stands for adjoint of A. Denote C/j := Pc^I ~ A/j) and 2} := 
Pq (I — Xgj) for i = 1,2, ... ,p and j = 1, 2, . . . , r, respectively. Define the 
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operator T : W 2 ^-W 2 by 

IJ2 



T(y) 



V Vp+r J 

(([/! ( yi ))* ,...,(U P (y p ))* , (Ti (y p+1 ))* , . . . , (T r (y p+r ))*)* , (6-29) 



where y x ,y 2 , • € #1 and y p+ i,y p+2 , ...,y p+r G # 2 - 

This leads to an SVIP with just two operators -F and G and two sets 
C and Q, respectively, in the product space, when we take C=H\, F = 0, 
QCW 2 , G(y) = (f l (yi)J 2 (y 2 )...J p (y p ),g 1 (y p+ i),g 2 (y p+2 ),...,g r (y p+r )), 
and the operator A : H 1 ^-W 2 . It is easy to verify that the following equiv- 
alence holds: 

x G * if and only if Ax G Q. (6.30) 



Therefore we may apply Algorithm 16. 1\ 

.fc+i = ^ + 7 a*(T - I)(Ar fc ) for all k > 0, 



.r 



(6.31) 



to the problem ( 16 . 2 6 [) — ( 16 . 2 9 [) in order to obtain a solution of the original 
MSSVIP. We translate the iterative step (16.311) to the original spaces Hi and 
H 2 using the relation 

T(Ax) = \^/oiUx(x), . . . , yfop~U p (x), -\/PiATi(x), . . . , \/~fi~ r AT r {x)^ 

(6.32) 

and obtain the following algorithm. 

Algorithm 6.4 

Initialization: Select an arbitrary starting point x° G Hi . 
Iterative step: Given the current iterate x k , compute 



x k+1 — x k 



+ 7 (5>(^ + £ frA* (Tj - I) (A 

3=1 



X 



i=l 



where 7 G (0, 1/L), with L = J2Li a i + ELi PjWM 2 - 



(6.33) 



The following convergence result follows from Theorem [6? 
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Theorem 6.5 Let Hi and H 2 be two real Hilbert spaces and let A : Hi — > 
H 2 be a bounded linear operator. Let /j : H\ — > Hi, i = 1,2, ...,p, and 
gj : H 2 — > H2, j = 1, 2, . . . , r, be a-ISM operators on nonempty, closed and 
convex subsets Ci C Hi, Qj C H 2 for i = 1,2, ... ,p, and j = 1,2, ... ,r, 
respectively. Assume that 7 G (0, 1/L) and ^ 7^ 0. Set Ui := Pdi.1 — A/j) 
and Tj := Pq. (I — Xgj) for i = 1,2, ... ,p and j = 1,2, ... ,r, respectively, 
with A G [0, 2a] . If, in addition, for each i = 1,2, ... ,p and j = 1,2, ... ,r 
we have 

(f t (x), P Ci (I - Xfi)(x) -x*)>0 for all x £ Hi (6.34) 
for all x* E SOL(d, fi) and 

( gj (x),P Q .(I - X 9j )(x) -x*)>0 for all x G H 2 , (6.35) 

for all x* G SOL{Ci, fi), then any sequence {x fc }^l , generated by Algorithm 
\6.1\ converges weakly to a solution point x* E ^> . 

Proof. Apply Theorem 16.31 to the two-operator SVIP in the product 
space setting with U = I : H x Hi, Fix?7 = C, T = T : W W, and 
FixT = Q. m 

Remark 6.6 Observe that conditions Ij6.34\ ) and h6. 35\) imposed on Ui and 
Tj for i — 1, 2, . . . , p and j = 1,2, . . . ,r, respectively, in Theorem \6.bl which 
are necessary for our treatment of the problem in a product space, ensure that 
these operators are firmly quasi-nonexpansive (FQNE). Therefore, the SVIP 
under these conditions may be considered a Split Common Fixed Point 
Problem (SCFPP), first introduced in Jlf, with C, Q, AandT :W 2 ^ W 2 
as above, and the identity operator I : C — )■ C . Therefore, we could also 
apply J2ty Algorithm J^.l]. If, however, we drop these conditions, then the 
operators are nonexpansive, by Lemma \3.10( i). and the result of [S^j would 
apply. 

7 Applications 

The following problems are special cases of the SVIP. They are listed here 
because their analysis can benefit from our algorithms for the SVIP and 
because known algorithms for their solution may be generalized in the future 
to cover the more general SVIP. The list includes known problems such as the 
Split Feasibility Problem (SFP) and the Convex Feasibility Problem (CFP). 
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In addition, we introduce two new "split" problems that have, to the best of 
our knowledge, never been studied before. These are the Common Solutions 
to Variational Inequalities Problem (CSVIP) and the Split Zeros Problem 
(SZP). 

7.1 The split feasibility and convex feasibility prob- 
lems 

The Split Feasibility Problem (SFP) in Euclidean space is formulated as 
follows: 

find a point x* such that x* e C C R n and Ax* e Q C R m , (7.1) 

where C C R n , Q C R m are nonempty, closed and convex sets, and A : R n — > 
R m is given. Originally introduced in Censor and Elfving [H], it was later 
used in the area of intensity-modulated radiation therapy (IMRT) treatment 
planning; see [151 EH]- Obviously, it is formally a special case of the SVIP 
obtained from f 1 1 . 1 [) — f TTT2|) by setting / = g = 0. The Convex Feasibility 
Problem (CFP) in a Euclidean space is: 

find a point x* such that x* G r\f =1 d ^ 0, (7.2) 

where Cj, i — 1, 2, . . . , m, are nonempty, closed and convex sets in R n . This, 
in its turn, becomes a special case of the SFP by taking in (17. ip n = m, A = I 
Q = R n and C = Pl^Cj. Many algorithms for solving the CFP have been 
developed; see, e.g., [TJ [23]. Byrne [5] established an algorithm for solving 
the SFP, called the CQ-Algorithm, with the following iterative step: 

x k+1 = P c (x k + 1 A\P Q - I)Ax k ) , (7.3) 

which does not require calculation of the inverse of the operator A, as in [14], 
but needs only its transpose A 1 . A recent excellent paper on the multiple-sets 
SFP which contains many references that reflect the state-of-the-art in this 
area is |31j. 

It is of interest to note that looking at the SFP from the point of view of 
the SVIP enables us to find the minimum- norm solution of the SFP, i.e., a 
solution of the form 

x* = argmin{||a;|| | x solves the SFP (17. ip }. (7.4) 

This is done, and easily verified, by solving f lLip -f TO]) with f = I and g = 0. 
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7.2 The common solutions to variational inequalities 
problem 

The Common Solutions to Variational Inequalities Problem (CSVIP), newly 
introduced here, is defined in Euclidean space as follows. Let {fi}™ =1 be a 
family of functions from R n into itself and let {Cj}™ 1 be nonempty, closed 
and convex subsets of R n with fl™ 1 Cj 7^ 0. The CSVIP is formulated as 
follows: 

find a point x* G H^Cj such that (fi(x*), x — x*) > 

for all x G Cj, i — 1,2, ... , m. (7.5) 

This problem can be transformed into a CVIP in an appropriate product 
space (different from the one in Section [5]). Let R mn be the product space 
and define F : R mn R mn by 

F ((*\ x 2 ,..., x m )) = (Mx 1 ), . . . , / m (x m )), (7.6) 
where x l G R n for all i — 1, 2, . . . , m. Let the diagonal set in R mn be 

A := {x G if™ I x={a, a,..., a), a e R n } (7.7) 

and define the product set 

C := n^C;. (7.8) 
The CSVIP in R n is equivalent to the following CVIP in R mn : 

find a point a?* G C fl A such that (F(a;*), a; — x*) > 

for all as = [x 1 , x 2 , . . . , x m ) G C. (7.9) 

So, this problem can be solved by using Algorithm 14.41 with Q = A. A new 
algorithm specifically designed for the CSVIP appears in 



7.3 The split minimization and the split zeros prob- 
lems 

From optimality conditions for convex optimization (see, e.g., Bertsekas and 
Tsitsiklis [31 Proposition 3.1, page 210]) it is well-known that if F : R n ->• R n 
is a continuously differentiable convex function on a closed and convex subset 
X C _R n , then x* G X minimizes F over X if and only if 

(VF(x*), x-x*)>0 for all x G X, (7.10) 
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where VF is the gradient of F. Since (I7.1(jp is a VIP, we make the following 
observation. If F : R n — > R n and G : R m — > R m are continuously differen- 
tiable convex functions on closed and convex subsets C C R n and Q C R m , 
respectively, and if in the SVIP we take / = VF and g = VG, then we 
obtain the following Split Minimization Problem (SMP): 



find a point x* G C such that x* = argmin{/(x) | x G C} (7-11) 

and such that 

the point y* = Ax* G Q and solves y* = argmin{g(?/) | y G Q}. (7.12) 

The Split Zeros Problem (SZP), newly introduced here, is defined as fol- 
lows. Let Hi and H 2 be two Hilbert spaces. Given operators Bi : H 1 — > Hi 
and B 2 ■ H 2 —> H 2 , and a bounded linear operator A : Hi — > H 2 , the SZP is 
formulated as follows: 

find a point x* G Hi such that B x (x*) = and B 2 (Ax*) = 0. (7.13) 

This problem is a special case of the SVIP if A is a surjective operator. To 
see this, take in ( |l.ip - (jl.2p C = Hi, Q = H 2 , f = B 1 and g = B 2 , and choose 
x := x* -Bi(x*) G Hi in (ITT1) and x e Hi such that Ax := Ax* -5 2 (Ar*) G 
#2 in (TOD. 

The next lemma shows when the only solution of an SVIP is a solution of 
an SZP. It extends a similar result concerning the relationship between the 
(un-split) zero finding problem and the VIP. 

Lemma 7.1 Let Hi and H 2 be real Hilbert spaces, and C C Hi and Q C H 2 
nonempty, closed and convex subsets. Let Bi : Hi — > Hi and B 2 : H 2 — >■ H 2 
be ct-ISM operators and let A : Hi — )■ H 2 be a bounded linear operator. 
Assume that C n {x G H t \ B x {x) = 0} ^ and i/iai Q n {y E H 2 \ B 2 (y) = 
0} 7^ 0, and denote 

T := r(C, Q, B ls S 2 , A) := G SOL(C, S x ) | Az G 50L(Q, ^2)} . (7.14) 

Then, for any x* G C with Ax* G Q, x* solves ( 7.15] ) i/ and on/y z/x* G T. 

Proof. First assume that x* G C with Ax* G Q and that x* solves 
(I7.13p . Then it is clear that x* G T. In the other direction, assume that 
x* e C with Ax* G Q and that x* G T. Applying (I3.4p with C as D there, 
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(J-A-Bi) (x*) G H Xl for any A G (0, 2a], as x there, and g x G CnFix(7-AB0, 
with the same A, as y there, we get 

|| gi _ Pc{1 _ X B 1 ) (x*)f + XB 1 ) (x*) - P C (I - XB 1 ) (x*)\\ 2 
< \\(I-XB 1 )(x*)-q 1 f, (7.15) 
and, similarly, applying (13. 4p again, we obtain 

\\q 2 - P Q (I - \B 2 ) (Ax*) f + ||(/- \B 2 ) (Ax*) - P Q {I - \B 2 ) (Ax*)\\ 2 
< \\(I - XB 2 ) (Ax*) - q 2 \\ 2 . (7.16) 
Using the characterization of (I3.19p . we get 

||g a - x*\\ 2 + - ABO (x*) - x*\\ 2 <\\(I- ABO (x*) - qi \\ 2 (7.17) 

and 

\\q 2 - Ax*\\ 2 + ||(7 - ABO (Ax*) - x*f < ||(7 - AB 2 ) (Ax*) - q 2 \\ 2 . (7.18) 

It can be seen from the proof of Lemma EUDO) that the operators I — \Bi 
and 7 — AB 2 are nonexpansive for every A G [0, 2a], so with qi G C R Fix(7 — 
ABO and g 2 G Q n Fix(7 - AB 2 ), 

||(7 - ABO (x*) - gi|| 2 < ||x* - gj 2 (7.19) 

and 

||(7 - AB 2 ) (Ax*) - q 2 \\ 2 < \\Ax* - g 2 || 2 . (7.20) 
Combining the above inequalities, we obtain 

Iki - x*\\ 2 + W - ABO (x0 - re* || 2 < ||x* - gif (7.21) 

and 

\\q 2 - Ax*f + ||(7 - AB 2 ) (Ax*) - x*\\ 2 < \\Ax* - q 2 \\ 2 . (7.22) 

Hence, ||(7 - ABO (x*) - x*|| 2 = and ||(7 - AB 2 ) (Ax*) - Ax*\\ 2 = 0. Since 
A > 0, we get that Bi(x*) = and B 2 (Ax*) = 0, as claimed ■ 
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